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Abstract 


‘The inaugural convening of the Historically Black College and University (HBCU) Collaboration for Excellence 
in Educational Quality Assurance (CEEQA) took place June 21-22, 2018, on the historic Morehouse School of 
Medicine campus in Atlanta, GA. Candid conversations around student learning outcomes assessment happening 
on HBCU campuses framed the conference agenda. These discussions centered on solutions to common 
assessment challenges and the need for an official HBCU collaborative of practicing and retired assessment 
professionals. This collaborative, the first of its kind, seeks to help address accountability measures while being 
true to HBCU missions and culturally relevant assessment approaches. Hence, as both internal and external 
accountability mandates increase, so too has the need for a strong HBCU alliance. 


‘The group met over the course of two-days and immersed themselves in professional development sessions and 
group work. From the Transparency Framework to the Role of Culture and Cultural Competence to Quality 
Assurance, the culmination of the event produced a newly formed collaborative including an organizational 
structure and future convenings. We found that CEEQA can offer significant resources and specific expertise to 
the HBCU community and higher education community writ large. This report presents the background and 
subsequent founding of the Collaboration for Excellence in Educational Quality Assurance. 
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All higher education institutions are responding to rapid transformation where 
transparency, accountability, and evidence of positive student learning drive the 
conversation (Ewell, 2009). Likewise, the higher education community must be 
able to demonstrate that student learning outcomes are being acted out in life, 
where students develop the knowledge and skills that are identified as essential 
(Kinzie, Hutchings, & Jankowski, 2015). In other words, what kind of outcomes are 
students achieving as a result of the curriculum? Hutton et al., (2012) suggested, the 
parent writing the check wants to know, “what is my child getting for the money?” 
One thing is, obviously, a job. But what else are students obtaining? Is their son or 
daughter more mature? More astute? Students want to know if the cost of 
attending college is worth it—in terms of time, effort, and future 
opportunities. Similarly, employers are asking: are students and graduates able to 
work with people from diverse backgrounds? 


Equally important is the ability to effectively communicate results of assessment, or 
the process an institution undertakes to gather and present evidence of improved 
student learning and institutional improvements, and what they mean to specific 
audiences (Kinzie, Hutchings, & Jankowski, 2015). Assessment is an effective 
mechanism by which to know what institutions are doing to support and achieve 
student learning, and includes evidence of the skills, knowledge, and dispositions 
a graduate should have. In short, through evidence of student learning, students, 
parents, policy makers, and the federal government should receive an agreeable 
message with different contexts regarding institutional outcomes. 


Historically Black Colleges and Universities (HBCUs), like other higher education 
institutions, must also be responsive to the public by providing evidence of student 
learning. An HBCU is a college or university that existed before 1964, and has a 
historic and contemporary mission of educating African Americans while being open 
to all students (Anderson, 1988; Provasnik & Shafer, 2004). HBCUs historically 
have served large populations of underrepresented, low-income, first-generation, and 
students of color (Nahal, Thompson, Rahman, & Orr, 2015; Wilson, 2007), while 
being severely underfunded (Anderson, 1988; Provasnik & Shafer, 2004; Toldson, 
2016). Thus, it is important to know how HBCUs respond to internal tensions 
(various needs of diverse student populations) and external tensions (potential 
families, the public, funding agencies, legislators, etc.). 


One of the many HBCUs strengths that helps define what makes them successful 
is their culturally relevant assessment practices (Montenegro & Jankowski, 2017), 
but how have they communicated or are communicating their success stories? The 
inaugural convening of CEEQA provides insight into the positive and negative 


One of the many HBCUs’ 
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aspects of accountability and transparency and unpacks the present assumptions _—— iy 


about HBCU assessment practices and student learning outcomes. 


There is very little knowledge about assessment, accountability, and student There is very little 

learning outcomes at HBCUs. Conversely, there is a significant problem in the | knowledge about assessment, 
current literature on assessment and student learning at HBCUs in that it has been accountability, and student 
studied primarily from a western European ideology (Arroyo & Gasman, 2014; learning outcomes at 

Ewell, 2002; Hood & Hopson, 2017; Montenegro & Jankowski, 2017). This is HBCU. Converse ly nihere 
problematic for many reasons, namely because western European philosophy does 


is a significant problem 


not consider diverse cultural contexts in which identities are constructed, or the | ~ ; 
effect of these social contexts on students studying at HBCUs. Undoubtedly, there | the current literature 

is a dearth of literature on assessment practices and student learning outcomes at | 0% assessment and student 
HBCUs that can be filled by listening to and learning from united voices of those learning at HBCUs in that 


who do the work, every day. it has been studied primarily 
from a western European 


HBCU Collaboration for Excellence in Educational Quality Assurance ie, logy. 


The inaugural convening of the HBCU Collaboration for Excellence in Educational 
Quality Assurance (CEEQA) took place June 21-22, 2018, on the Morehouse 
School of Medicine campus in Atlanta, GA. Assessment and institutional 
effectiveness professionals from ten Historically Black Colleges and Universities 
(HBCUs) gathered for an invite only event that included candid conversations 
on assessment of student learning outcomes happening on their campuses. Other 
invited guests included representatives from the National Institute for Learning 
Outcomes Assessment (NILOA), a representative from the Southern Association 
of Colleges and Schools Commission on Colleges, and Watermark, an assessment 
technology vendor. 


Discussions centered on solutions to common assessment challenges and the 
need for an official HBCU collaborative of practicing and retired assessment 
professionals and advisory committee. The group met over the course of two-days 
and immersed themselves in professional development sessions and group work: 
From “E-Solutions to Outcomes Assessment” to “Quality Assurance in Assessment” 
to “Trends of Assessment,” the culmination of the event produced a newly formed 
collaborative including an organizational structure and future convening schedule. 


Planning and Execution 


Siloed conversations about an official organization of and for HBCU assessment 
professionals have been happening for years. Out of those discussions a more 
intimate dialogue was taking place among members of the HBCU community 
within the Southern region. These colleagues enjoy a working relationship rooted 
in collegiality, mentorship, and professional development. Some met as members 
of a special interest group of the Association for Institutional Researchers (AIR) 
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while others have worked together as campus level administrators, and others 


met while serving as assessment coaches. These comrades who share 35+ years of 
experience at HBCUs teamed up to conceptualize and seek guidance on a formal 
convening of HBCU assessment professionals. It is noteworthy to share that all 
but one of the original group member's institutions are a part of the Southern 


Association of Colleges and Schools Commission on Colleges (SASCOC). 
2017 Assessment Institute 


To stay informed on the latest research on assessment, some soon to be CEEQA 
founding members attended the 2017 Assessment Institute in Indianapolis, 
IN. During this conference they gathered and attended various plenary sessions 
together. This particular conference presented an opportunity for organizers to 


glean ideas and discuss the impending convening. Every chance they got to gather 
as a group during this two-day conference—between sessions, lunch, and dinner 
—HBCU colleagues strategized and sought out advice from seasoned assessment 


experts. Before the 2017 Assessment Institute’s closing activities, the group 
gathered one last time to support colleague’s featured on the NILOA Track panel, 
“Assessment at Historically Black Colleges and Universities” where nine different 
HBCUs were highlighted. As one member stated, this panel was the perfect climax 
to end a collegial experience and “finally not feel alone” at the Assessment Institute 
or my home institution. 


Participants returned to their campuses reenergized and ready, and agreed to move 
forward with scheduling their first official meeting for the following summer. The 
first order of business included identifying local colleagues who could assist with 
administrative support and soliciting sponsorship from an established organization 
that focuses on assessment and student learning outcomes. They also agreed that 


the first meeting would be held in Atlanta, starting as a small work group headed 
up by members of the Atlanta University Center Consortium—Clark Atlanta 
University, Morehouse College, Morehouse School of Medicine, and Spelman 


College—that will eventually evolve into a national convening for HBCUs. 


This invitation only event targeted HBCU assessment directors, institutional 
effectiveness professionals, and vice/assistant presidents for research, etc. (see 
Appendix A). Colleagues from the Atlanta University Center Consortium 
undertook the task of getting the word out and raising interest, while Florida 
A&M's Office of University Assessment was instrumental in surveying potential 
participants regarding their specific needs and interests. The HBCU Collaborative 
Interest Survey (see Appendix B) was launched on April 19, 2018. 


As researchers and practitioners, CEEQA founding members are aware that little 
attention has been paid to the specifics of how HBCUs provide a variety of options 
for gathering, documenting, using, and sharing meaningful actionable evidence of 
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student learning on their campuses. In that spirit, it is important to note (1) the eT 


inaugural institutions represented at the convening and (2) the deliverables (noted 


below) that highlight CEEQA’s commitment to the cause. 
Convening Deliverables 


By the end of the 2-day professional development event, participants: 


1. Created an organizational structure, 

2. Refined the vision and scope of the collaborative, 

3. Determined salient points of collaboration for the initiative, 

4, Outlined a plan and timeline for future engagements, and 

5. Committed to scholarly collaboration for publication opportunities. 
CEEQA Statement 


The Office of Educational Outcomes and Assessment at Morehouse School 
of Medicine, the Office of University Assessment at Florida Agricultural and 
Mechanical University, along with the National Institute for Learning Outcomes 
Assessment teamed up to conceptualize the HBCU Collaboration for Excellence 
in Education Quality Assurance (CEEQA). 


‘The goals of CEEQA are to: 


1. Maximize the use of tools, processes, and human resources dedicated to 
outcomes assessment and evidence-based decision making at partner HBCU 
institutions, 

2. Enhance the use of systematic, evidence-based practices for assessment and 
institutional effectiveness among partner institutions to more effectively 
communicate assessment outcomes to internal and external stakeholders, 

3. Provide a platform for showcasing the culturally relevant assessment 
and evaluation practices that are used at HBCUs to tell our story and to 
demonstrate the impact of HBCUs within the academy, and 

4, Provide an opportunity for shared scholarly output in the form of joint 
research, publications, and conference presentations for assessment, 
institutional research, and institutional effectiveness professionals at partner 
institutions. 


Vision Statement 
‘The vision of CEEQA is to leverage the collective expertise of assessment professionals 


to promote the use of best-practices in assessment and evaluation and to demonstrate the 
effectiveness of HBCUs in the achievement of common educational aims. 


The inaugural convening 

included a community of 

scholars of color dedicated 

to build on rich histories 

and legacies in ways that 

speak to our current terms 

about quality assurance, 

accreditation, and assessment. 
—CEEQA Founding Member, 

2018 
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Work Group Outcomes and Takeaways 


IL, 


HBCU assessment professionals work centers on culture, competence, care, 


and compliance. 


Perhaps some of the ways we assess are not viewed in the typical vein of PW. 
We are constantly doing qualitative assessment because we have to pay attention 
to our surroundings (as a part of our survival as a people). We understand our 
students, particularly first-generation students, who perhaps dont need as much 
academic support as navigating college culture and language. We teach out of love, 
we mobilize resources, a lot of what we are doing is in service to our students. The 
literature does not validate what we are doing all the time - but we are doing it. 
—CEEQA Founding Member, 2018 


. Institutional leadership is vital in supporting assessment activities. 


I think its not so much that we dont know what we need to do in order to help 
students be successful but is more so that we have not had the constant leadership 
and the courage to do what we need to do in order to help our students be successful. 
Only truly viable institutions are those that are servant led where they put the 
interest of others before their own. 


—CEEQA Founding Member, 2018 


3. Intentional, intrusive, and appreciative advising is the heartbeat of their work. 


4, It is important, indeed vital for HBCUs to be at the forefront of their student 


Constant contact with students goes hand-in-hand with mentoring, peer 
mentoring, etc. It is essential for students to understand their transition to the 
university and how important it is to be a part of this particular community... 
and the great responsibility they have as members of this community. 


—CEEQA Founding Member, 2018 


learning outcomes success stories. 


5. HBCUs must remain student focused and address myriad possibilities and 


We have skirted around trying to explain our relevance or to prove why we are 
relevant...we are relevant because we do this for our community. There are two 
choices 1. Tell our own story, or 2. Our story being told for us... but the story will 
be told. 


—CEEQA Founding Member, 2018 


challenges their diverse student populations possess. 


We need to understand where our students are excelling and falling short. We 
should celebrate successes and seek to understand shortfalls from an empirical 
standpoint versus an anecdotal standpoint and then develop and fund proven 
evidence-based programs and strategies that are going to fill those gaps. In some 
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instances we can identify and know where the gaps are but we dont find the _——————— 


strategies that we need to plug those gaps and oftentimes try to put on superficial 
Band-Aids with the hope that it will be addressed somewhere down the road. 


~CEEQA Founding Member, 2018 | 4£BCUs employ various 
assessment approaches that 


6. HBCUs employ various assessment approaches that consider various needs (i.e. | ggmsider various needs (i.e. 
culture and diversity) of their student populations. culture and diversity) of their 


Culture reflects the way people give priorities to goals, how they behave in different student populations. 
situations, and how they cope with their world and with one another. Culture 
is transmitted from generation to generation. Likewise, culture and traditions at 
HBCUs are deeply rooted in the consciousness of their leaders, faculty, staff, and 


students. 
—CEEQA Founding Member, 2018 


7. There isan HBCU compliance and authenticity tug of war. 


Oftentimes when institutions frame this work around accountability namely 
SACSCOC andlor specialized accreditation what you get is what I call the path 
of least resistance—where we are engaging this work in an effort to get a clean 
bill of health and that can be superficial because what oftentimes happens within 
our institutions is that it masks the real issue, you get a clean bill of health, but 
it masks the core issues because we are not really reflecting on the process in a way 
that is tied to continuous improvement. 


—CEEQA Founding Member, 2018 
Summary 


Grateful to be at the table, with people that lead and do this work every day... 
humbled, and sort of saddened by the fact that there were not more of us there, but 
I know that is not an indication of their lack of commitment. There is so much 
going on on our campuses that PWIs have no clue about - so we have to cherry 
pick on what we can engage in. A lot of hearts were with us, but they could not 


all physically be there. 
—CEEQA Founding Member, 2018 


Understanding how HBCUs respond to the needs of their students is deserving 
of scholarly attention. Again, HBCUs historically have served large populations 
of underrepresented, low-income, first-generation, and students of color while 
being severely underfunded (Anderson, 1988; Nahal, Thompson, Rahman, & 
Orr, 2015). Distorted images and stereotypes based on race and gender have 
obstructed the larger society’s view of HBCUs and subsequently their relevance in 
the 21st century. CEEQA was created as a safe space and repository of information 
where HBCUs can collaborate and share best practices. This collaborative aims to 
tell the HBCU assessment story and functions as an active professional learning 


community. 
National Institute for Learning Outcomes Assessment 


The inaugural convening of the Collaboration for Excellence in Educational 
Quality Assurance provided a distinct, first glimpse into an intentionally 
organized gathering of assessment and institutional effectiveness professionals at 
HBCUs. CEEQA members shared mechanisms for respecting and acknowledging 
their diverse student populations and their experiences as they lead assessment 
initiatives on their campuses. Our hope is that after absorbing the lessons born 
out of CEEQA’s founding and mission, sincere, substantive, scholarly inquiry of 
student learning outcomes at HBCUs will follow. 


CEEQA is a timely collaborative gathering and a step in the right direction to 
foster more inclusive discussions on assessment and student learning outcomes at 
HBCUs. CEEQA is a collective movement that is positioned well to fill gaps in 
the literature, create opportunities for change, and be the new voice embedded 
in practice implications and consequences. Additionally, CEEQA is thoughtfully 
moving in the right direction by identifying potential partners, publishing and 
building on this new level of scholarship. The deep rooted culture and traditions 
at HBCUs have always been closely held by steady and careful hands - now their 
student learning outcomes success stories and lessons will positively impact the 
larger assessment conversation with CEEQA at the lead. 


Our hope is that after 
absorbing the lessons born 
out of CEEQA’s founding and 
mission, sincere, substantive, 
scholarly inquiry of student 
learning outcomes at HBCUs 


will follow. 
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Founding Members 


Rhea Brinson - Morehouse School of Medicine, Atlanta, GA 
Valerie Gardner - Morehouse School of Medicine, Atlanta, GA 
Angelita Howard - Morehouse School of Medicine, Atlanta, GA 
Mark Howse - Morehouse School of Medicine, Atlanta, GA 
Natasha Jankowski - National Institute for Learning Outcomes Assessment, Champaign, IL 
Tarji Kinsey - Clark Atlanta University, Atlanta, GA 
Kimberly Lebby - Lane College, Jackson, TN 
Lauren Lopez - Clark Atlanta University, Atlanta, GA 
Jamillah McDaniel - Morehouse School of Medicine, Atlanta, GA 
Mable Moore - Savannah State University, Savannah, GA 
Verna Orr - National Institute for Learning Outcomes Assessment, Champaign, IL 
DeShawn Preston - Morehouse School of Medicine, Atlanta, GA 
Shontell Stanford - Morehouse School of Medicine, Atlanta, GA 
Laura Stuck - Morehouse School of Medicine, Atlanta, GA 
Stephanie Suddith - Clark Atlanta University, Atlanta. GA 
Itihari Toure - Interdenominational Theological Center, Atlanta, GA 
Michael Wallace - Howard University, Washington, DC 
Cassandra Ward - Meharry Medical College, Nashville, TIN 
Tiffany Watson - Spelman College, Atlanta, GA 
Ereka Williams - North Carolina A&T State University, Greensboro, NC 
Pamela Woods - Morehouse School of Medicine, Atlanta, GA 


Maggie Yin — Clark Atlanta University, Atlanta, GA 
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Appendix B 


HBCU Collaborative Interest Survey 


& Results 
Survey: 
1. Name 
2. ‘Title 
3. — Institution 
4, Years of service in position 
5. Rank the following in terms of importance: 


a. Quality Assurance in Assessment Processes 

b. Professional Development Plan for Assessment 

c. Curriculum and Assessment Alignment Maps 

d. Program Assessment Rubrics 

e. Elements of Academic Program Review 

f. Data Visualization Tools 

g. Assessment and Accreditation 

What best practice or strength can you share with others as part of this collaborative? 

What issue of topic of discussion would be most beneficial to you in the work of this collaborative? 


What suggestions or thoughts can you offer to strengthen the value and success of the collaborative? 


HBCU Collaborative Interest Survey Results 


Table 1. CEEQA Members’ Position Title at the Time of Convening 


Position Title % Count 


Assistant Vice President with responsibility for 14.29% 2 
Institutional Effectiveness 


Director of Institutional Effectiveness 
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Table 2. Detailed Position Title of CEEQA Members Who Answered “Other” 


Position Title b — Other (Please specify your position title 


Associate Dean, Curriculum Evaluation & Effectiveness 
Director of Institutional Research & Assessment 
Vice President of Institutional Effectiveness and Strategic Initiatives 


Director, Institutional Research 


Table 3. Time (in years) CEEQA Members Have Held Their Current Position 


Time in Current Position % Count 


: 


More than 10 years 15.38% 


6 
6 
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Table 4. CEEQA Members’ Ranking of Most Important Support Activities and Points of Emphasis for CEEQA 


Note:Participants were asked to rank the following items 1 through 7 in terms of importance (with 1 being very 
important). The yellow boxes highlight which item was most likely to be ranked 1-7 respectively. For example, 
“Assessment and Accreditation” was most likely to be first on participant’s rankings, “Quality Assurance in 


Assessment Process” was most likely to be second, and so on. 


Quality Assurance 
in Assessment 
Process 


Professional 
Development Plan 
for Assessment and 

IE Personnel 


Curriculum and 
Assessment 


Alignment Maps 


Program 
Assessment 


Rubrics 


Elements of 
Academic 
Program Review 


Data Visualization 
Tools 


Assessment and 
Accreditation 


Finally, CEEQA members were asked to share their valuable insights an takeaways from the convening so that 
others may learn and advance this work on their own campus. Specifically, participants were asked: 


1. What best-practice and or strength can you share with others as a part of this collaborative? 
2. What issue or topic of discussion would be most beneficial to you in the work of this collaborative? 
3. What suggestions or thoughts can you offer to strengthen the value and success of the collaborative? 


Some of their responses are highlighted in the following page. 
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What best-practice and or strength can you share with others as a part of this collaborative? 


I can share our experiences transitioning from a paper-based process to documenting assessment activities to an 
institution-wide cloud-based platform designed to help manage the process in addition to affording programs 
and units the ability to align outcomes to accreditation standards and strategic priorities at the institutional 
level. 

I have written books, books chapters, and articles and have made multiple presentations nationally and 
internationally on Evaluation (i.e., products, programs, processes, personnel). 

Culturally Responsive Evaluation. 

As a IR person, I can share the databases we had at my institution which support assessment for best practice. 
Leading program area faculty through curricular/assessment/accreditation reviews Introducing faculty to 
VALUE rubrics (nationally recognized) assessments for improved outcomes and narratives of their degree 
programs. 

Determining metrics for program evaluation and evaluating programs. 

Professional development for shifting and creating assessment cultures for higher education. 

Institutionalize Assessment so that the units do not lose momentum in completing on-going assessment work as 
turnover occurs in the organization. 

Models for IE, Framework for assessing quality, strategic planning models. 


What issue or topic of discussion would be most beneficial to you in the work of this collaborative? 


Building and sustaining an institutional culture for meaningful assessment that serves to move the institution 
forward. 

How we can identify promising practices (a.k.a. best practices) and support each other to improve our own 
practices. 

Constructing Learning Benchmarks responsive to liberative epistemologies. 

How to build campus climate of using IR data for assessment purpose. 

The utilization of data analytics. 

How to be creative with your Universitys resources and support for assessment. 

Best practices for collection of evidence and artifacts and integrating those in the assessment cycle for analysis and 
decision-making. 

Assessing Student Learning. 


What suggestions or thoughts can you offer to strengthen the value and success of the collaborative? 


Plan in advance, identify key roles and responsibilities, and most importantly expected outcomes. 

Hopefully we will include sense making sessions that consider the intersectionality of justice issues and traditional 
discipline outcomes which often times frames the context of content in the HBCU setting. 

Thoughts on establishing responsivelcollaborative/systemic practices and protocol (campus culture) that live (or 
outlive) beyond individuals and turnover in Institutional Effectiveness units at HBCU. 

At the onset, I would like the collaborative to establish outcome measures and set timelines for publishing and 
presenting at national conferences. 

Provide as many easy to follow, practical steps as possible to guide work when the participants return to their 
institutions. Maybe a practitioner’ guide or checklist? 

Be willing to share with transparency. 
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About NILOA 


¢ The National Institute for Learning Outcomes Assessment (NILOA) was 
established in December 2008. 


« NILOA is co-located at the University of Illinois and Indiana 
University. 


« The NILOA website contains free assessment resources and can be found at 
http://www. learningoutcomesassessment.org. 


« The NILOA research team has scanned institutional websites, surveyed chief 
academic officers, and commissioned a series of occasional papers. 


e NILOA’s Founding Director, George Kuh, founded the National Survey for 
Student Engagement (NSSE). 


¢ The other co-principal investigator for NILOA, Stanley Ikenberry, was pres- 
ident of the University of Illinois from 1979 to 1995 and of the American 
Council of Education from 1996 to 2001. 


NILOA Staff 


Natasha Jankowski, Director 


Gianina Baker, Assistant Director 
Katie Schultz, Project Manager 
Erick Montenegro, Communications Coordinator and Research Analyst 


Verna F. Orr, Research Analyst 


NILOA Senior Scholars 


Peter Ewell, Senior Scholar 


Pat Hutchings, Senior Scholar 

Stanley Ikenberry, Co-Principal Investigator 

Jillian Kinzie, Senior Scholar 

George Kuh, Founding Director, Senior Scholar, and Co-Principal Investigator 
Paul Lingenfelter, Senior Scholar 

David Marshall, Senior Scholar 


If you would like more information on the innovative work of CEEQA, please contact us at 
niloa@education. illinois.edu. 
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For more information, please contact: 


National Institute for Learning Outcomes Assessment (NILOA) 
University of Illinois at Urbana-Champaign 

51 Gerty Drive 

Suite 196, CRC, MC-672 

Champaign, IL 61820 


learningoutcomesassessment.org 


niloa@education. illinois.edu 
Phone: 217.244.2155 


